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ABSTRACT 

In multivariate regression estimation, the rate of convergence depends on the dimension 
of the regressor. This fact, known as the curse of the dimensionality, motivated several 



works. The additive model, introduced by Stone (llOl ). offers an efficient response to this 
problem. In the setting of continuous time processes, using the marginal integration method, 
we obtain the quadratic convergence rate and the asymptotic normality of the components 
of the additive model. 



1 Introduction 

Let Z t = (X 4 , Yt)(t£R) be a M. d x E- valued measurable stochastic process defined on a prob- 
ability space (Q,A,P) with d > 1. Let Ci, C,i, be d compact intervals of IR and set 
C = C\ X ... X Cd- Set now 5 > and introduce the (^-neighborhood C s of C, namely 
C s = {x : inf y6 c ||x — y|| R d < 6}, with || • || K d standing for the euclidian norm on M, d . Let ip 
be a real valued measurable function. Consider the regression function defined by, 

m^x) = E (ip(Y) | X = x) , V x = (x u x d ) G C s . (1) 

Let K be a kernel defined on M d and having a compact support. Let be the estimate of 
/, the density function of the covariable X, (see Banon |l|)), defined by, 

/tW = ^ [ T K(^-)ds, 



Th^ Jq V fix / 

where hx is a given real positive function. In the sequel, to estimate the regression function 
defined in ([T]), we use the following estimator (see, for example, Bosq (jl) and Jones et al.(0)) 



T UUj^K t 



'x t -X< 



m^ jT (x) = / W T>t (^(Y t )dt with W T)t (x) = — ^j— hl ' T , (2) 

Jo J JTV&t) 

where {hj t T)i<j<d are positive real functions and (-Kz)i<j<d are d kernels defined on M with 
compact supports. Consider now that the nonparametric regression function ([1]) may be 
written as a sum of univariate functions, i.e. 
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d 

77ty(x) = fi + ^ m l( X l) =: m i>,add( x ), V X = (Xt, X d ) G C 5 , (3) 

where, for 1 < I < d, Emi{Xi) = 0. For 1 < I < d and any x = (xx,..,Xd) G C 5 set 
x_; = (xi, .., .., Xrf). To estimate the additive components, we use the marginal 

integration method (see Linton & Nielsen (J8|) and Newey (j9|)). To this aim, we introduce d 
densities qi,...,qd defined on R and set g(x) = Yli=iQi{ x i) an d Q-ii^-i) = Ylj^iQj{ x j) = 
1, d}. We can then write 



d p 

m v ,(x) = S2r]i(xi) + / m^(z)q(z)dz 



(4) 



with 



with r)i(xi) : = / m,/,(x)g_j(x_i)(fx_j - / m v ,(x)g(x)<ix 

= mi(xi) - / mi(z)qi(z)dz, 1 < I < d. (5) 



Making use of the statements ([2]) and ([5]), it follows that a natural estimate of the Z-th 
component is given by 



rji,A x i) = / m v , 5T (x)g_ z (x_ / )(ix_ i - / m^ iT (x)g(x)dx, Z = 1, 

2 Hypotheses and Notations 

In order to state our results, we introduce some assumptions and additional notations. 

(C.l) There exists a positive constant M such that, for any t/Gl, iVKl/)! — M < oo, 
(C.2) m^p is a /c-times continuously different iable function, k > 1, and 



(6) 



sup, 



0z* 



< oo; 1 < Z < 



For 1 < / < d, we denote by the density function of X t and we suppose that the functions 
/ and fi are continuous and bounded. We need the additional conditions 



(F.l) Vx G C s , /(x) > and /,(a;,) > 0, Z = 1, d, 

(F.2) f is /c'-times continuously differentiable on C 5 , k! > kd, 

< Lllx' - x|| A with ji + ... + = fc'. 



(F.3) for some < A < 1, -#^(x') - -#^(x) 



Here |.| states as a norm on IR d , L is a positive constant and we note r := k' + A. 
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The kernels K and Ki, 1 < I < d are assumed to fulfill the following conditions 

(K.l) For 1 < I < d, K and K\ are continuous on compact supports S and Si C Ci, 
respectively, 

(K.2) J K = 1 and J Kj = 1, 1 < / < d, 
(K.3) Yij=i Kj is of order k, 
(K.4) is of order k! . 

The known integration density functions qi, 1 < / < d, satisfy the following assumption 

(Q.l) qi has k continuous and bounded derivatives, with compact support included in 
Ci, 1 < I < d. 

There exists Y G B R 2 containing D = {(s, t) G 1R 2 : s = t} such that 

(D.l) /(x S! y s ),(x t ,y t ) - /(x s ,y s ) /(x t ,y t ) exists everywhere for (s,t) G T c , 
(D.2) A r := sup (s t)er c sup XiygC . xC5 J u>veR2 |/(x 3 ,y s ),(x t ,y t )( x ' u 'y^)- 
/(x s y 3 )(x,u)/ (Xt ,y)(y,^)M^ < oo, 

(D.3) there exists £r < oo and T such that, VT > T , |; Jj 0T ]2 nr dsdt < £r- 

We will work under the following conditions on the smoothing parameters Jit and hj t x, 3 — 
l,...,d. 

f. rr ,\l/(2k'+d) 

(H.l) h T = c'(^j , for a fixed < d < oo, 

(H.2) h j>T = c{r- l / {2k+1 \ for fixed < d < oo. 

Let A and B be two a-fields. We will use the a-mixing coefficient defined by 

a(A,B)= sup \P(Af] B) - P(A)P(B)\. 

For all Borel set / C M + the cx-algebra defined by (Z t , t G /) will be denoted by cr(Z t , t G /). 
Writing a(u) = sup 4gM+ v < t), a(Z v , v > t + m)), we will use the condition 

(Al) a(t) = 0(t- b ) with b > Zg*. 

We denote by rj lT and ^^^(x) the versions of and m^^x) corresponding to a known 
density /. Introduce now the following quantities (see, for the discrete case, Camlong et al. 

(II)), ' 
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%,t,u =ip{Y t ) [ i[T- K i C\ ^'O^V^iy s d*-i;fhli(*i) = E{Y^, U X ttt =x{); 

Th ltT J fi{X tj i) \ hi >T / y R d-i %t V %t / 

C T ,i=H+ / y^m J -(wj)^(u_{)du_{;Cr= / m^ )T (x)g(x)dx; C; = / mi(xi)qi(xi)dxi; 



M*i) = ^ / u*iir / (u)d«f(-l) fc m l ( * ) (^)+ / m^g^d*). 



3 Results 

The proofs of our Theorems are split into two steps. We first consider the density as known, 
and then treat the general case where / is unknown by using the decomposition 1/f = 
1//t — (/ ~~ fr)/ ffr and the following lemma. 

Lemma 1 Under the assumptions (F.l) - (F.3), (K.l), (K.2), (KA), (D.l) - (D.3), (H.l) 
and (AA)we have 

/ Aos.T\ k '/( 2k '+ d )\ 

BU P / T X)-/X =0((-|^J ) O.8.. (7) 



xec 



T 



Proof: It is easily seen that under our assumptions, the result follows by using the arguments 
used in the demonstration of Theorem 4.9. in (Q) p. 112 and by replacing log m by 1. 

Theorem 1 Under assumptions (C.l) - (C.2), (F.l) - (F.3), (F.l) - (KA), (QA), (DA) - 
(D.3), (HA) - (H.2) and (AA) we have 



Sketch of the proof: Observe that 

Vi,t(xi) - 7)i(xi) = {t)i,t(xi) - Vi,t( x i)} + {&i(xi) - Eai(xi)} + {Eai(x t ) - m^(a^)}(8) 
+E{C T — C Tj i — Gj- 
It follows that 

E{% T (xi) - Vi(xi)} 2 < ±E{m,T{xi) ~ %t(xi)Y + 4F{d,(x / ) - Ea^)} 2 + 4{Fd / (x / ) - mj/zj)} 5 

+4F 2 {CV - C T ,i - Q}. 
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To prove the Theorem [TJ it suffices to establish the following statements 

^(%T(xO-^ r (x ; )) 2 = ofT^ +1 )), (9) 



Var(a l (x l )) = 0(T- 2k ^ k+1 ^ (10) 
Eaz(x l )-m^x l ) = o(T- k '^), (11) 
E(C T - C T)i + d) = o(T- k/{2k+1) y (12) 

Proof o/0' By combining the definitions of rj\p and rj 1 T and the result of the lemma (TJ we 
easily obtain, under the conditions on the kernel, the statement ([9]). 

Proof of m Set 0(M) = Cov( 7 Jg fe K 1 (^) , j^SfcK (^)) and S a(T) = 
{(s, t) G M. 2 ; \t — s\ < a(T)}, where a(T) = Kif, . We use the following decomposition 

Var(«i(xi)) = / <f)(t, s)dtds + / <f>(t, s)dtds + / s)dtds := A + E + F. 

i[o,T] 2 nr i[o,T] 2 nr c n5 a(T) i[o,T] 2 nr c n5^ (T) 

Under (CM), (F.l), (K.l) — (K.2) and (Q.l), we have, for T large enough, 

4=0(1/%) and E = o(a(T)\\K 1 \\l i A f (T)/Ty (13) 

Using the Billingsley's inequality, it follows that 

F = o(l/Th\ T a(T)y (14) 

Combining ([TBI and (JHJ), we obtain ffTOl . To prove the statements ffTTl) and ffl~2]) . we use 
similar arguments as in the discrete case (see Camlong et al. (|4j)). 



The next Theorem needs the following additional hypothesis. 

(V) liminf T ^oor/ii )T Var(^ jT (xO) > where (log(T)/T) fc '/(2fc'+d) = o(h k T ). 

Theorem 2 Under the hypotheses of Theorem^ and (V) we have, for every V7 G [1, d] and 

rjiA x i) ~ Vi( x i) ~ hl T bi(x t ) C) ^ Q ^ 
• V /Var(r/ 2)T (^)) 

Sketch of the proof: To obtain our theorem it suffices to show that 

sup \t]i,t( x i) - Vi,t( x i)\ = 0[ sup |/r(x) - /(x)| ) a.s., (15) 

{&i{xi) - E(ai(xi))} 



Af(0,l), (16) 



A /Var(d / (x i )) 

E&fa) - mj» = t^rnt\xi) [ vfK^dv, + o(h k T ), (17) 



and E{C T -C Til + C l } = ^ [ q^\x l )m l (xi)dxi f vfK^v^ + o(/i? T ). (1* 



Proof of\ 1 3c The result arises directly from the definitions of estimates of r\\ and the conditions 
on the kernels Ki, 1 < I < d. 
Proof of\m Set 



y/Vaxfilixi)) 



Jq Z t dt —: St- We employ then the big block-small block 



procedure. Indeed setting, St = Y^j=i( u j + £j) =: S't + where v 3 = J^^^ +p Z t dt and 



0'+l)(P+9) 
(p+q)+p 



Z t dt. Now, it suffices to prove the following statements, 



-oo, 



as T-> +oo, 



(19) 
(20) 

(21) 

(22) 



To show (12T|) et (|22|) . we use the same arguments as those deployed in the discrete case. 

Lemma 2 Under the conditions (C.l) - (CA), (F.l) - (F.2), (K.l), (Q.l) - (Q.2) and 
(if.l) — (H.2), we have, for every 1 < I < d and for any x\ G C\ and every (a, (3) G 
]0;0,5[x]0,5;l[ ; 



ES T 2 -> 


as T 




fc-i 


P(e^) - 






j=0 


fc-i 






> 1 as 


j=0 




fc-i 




and P 




3=0 





liminf p(t »+i {^,t(^) - tyfa) - frfrMzi)} G [^9a5 ^fla]) > P - <*, 

T— >oo \ / 



(23) 



where A := ( limsup T ^ +00 T 2fe +! Var^T^z))) 1 / 2 and g u is suca that P(JV(0, 1) < g u ) = n 
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